Analysis of COVID-19 Guideline Quality and Change of Recommendations: A Systematic Review

Background Hundreds of coronavirus disease 2019 (COVID-19) clinical practice guidelines (CPGs) and expert consensus statements have been developed and published since the outbreak of the epidemic. However, these CPGs are of widely variable quality. So, this review is aimed at systematically evaluating the methodological and reporting qualities of COVID-19 CPGs, exploring factors that may influence their quality, and analyzing the change of recommendations in CPGs with evidence published. Methods We searched five electronic databases and five websites from 1 January to 31 December 2020 to retrieve all COVID-19 CPGs. The assessment of the methodological and reporting qualities of CPGs was performed using the AGREE II instrument and RIGHT checklist. Recommendations and evidence used to make recommendations in the CPGs regarding some treatments for COVID-19 (remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir) were also systematically assessed. And the statistical inference was performed to identify factors associated with the quality of CPGs. Results We included a total of 92 COVID-19 CPGs developed by 19 countries. Overall, the RIGHT checklist reporting rate of COVID-19 CPGs was 33.0%, and the AGREE II domain score was 30.4%. The overall methodological and reporting qualities of COVID-19 CPGs gradually improved during the year 2020. Factors associated with high methodological and reporting qualities included the evidence-based development process, management of conflicts of interest, and use of established rating systems to assess the quality of evidence and strength of recommendations. The recommendations of only seven (7.6%) CPGs were informed by a systematic review of evidence, and these seven CPGs have relatively high methodological and reporting qualities, in which six of them fully meet the Institute of Medicine (IOM) criteria of guidelines. Besides, a rapid advice CPG developed by the World Health Organization (WHO) of the seven CPGs got the highest overall scores in methodological (72.8%) and reporting qualities (83.8%). Many CPGs covered the same clinical questions (it refers to the clinical questions on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir in COVID-19 patients) and were published by different countries or organizations. Although randomized controlled trials and systematic reviews on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir for patients with COVID-19 have been published, the recommendations on those treatments still varied greatly across COVID-19 CPGs published in different countries or regions, which may suggest that the CPGs do not make sufficient use of the latest evidence. Conclusions Both the methodological and reporting qualities of COVID-19 CPGs increased over time, but there is still room for further improvement. The lack of effective use of available evidence and management of conflicts of interest were the main reasons for the low quality of the CPGs. The use of formal rating systems for the quality of evidence and strength of recommendations may help to improve the quality of CPGs in the context of the COVID-19 pandemic. During the pandemic, we suggest developing a living guideline of which recommendations are supported by a systematic review for it can facilitate the timely translation of the latest research findings to clinical practice. We also suggest that CPG developers should register the guidelines in a registration platform at the beginning for it can reduce duplication development of guidelines on the same clinical question, increase the transparency of the development process, and promote cooperation among guideline developers all over the world. Since the International Practice Guideline Registry Platform has been created, developers could register guidelines prospectively and internationally on this platform.

Guidelines for the prevention and management of children and adolescents with COVID-19.

Children are the future of the world, but their health and future are facing great uncertainty because of the coronavirus disease 2019 (COVID-19) pandemic. In order to improve the management of children with COVID-19, an international, multidisciplinary panel of experts developed a rapid advice guideline at the beginning of the outbreak of COVID-19 in 2020. After publishing the first version of the rapid advice guideline, the panel has updated the guideline by including additional stakeholders in the panel and a comprehensive search of the latest evidence. All recommendations were supported by systematic reviews and graded using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. Expert judgment was used to develop good practice statements supplementary to the graded evidence-based recommendations. The updated guideline comprises nine recommendations and one good practice statement. It focuses on the key recommendations pertinent to the following issues: identification of prognostic factors for death or pediatric intensive care unit admission; the use of remdesivir, systemic glucocorticoids and antipyretics, intravenous immunoglobulin (IVIG) for multisystem inflammatory syndrome in children, and high-flow oxygen by nasal cannula or non-invasive ventilation for acute hypoxemic respiratory failure; breastfeeding; vaccination; and the management of pediatric mental health. CONCLUSION: This updated evidence-based guideline intends to provide clinicians, pediatricians, patients and other stakeholders with evidence-based recommendations for the prevention and management of COVID-19 in children and adolescents. Larger studies with longer follow-up to determine the effectiveness and safety of systemic glucocorticoids, IVIG, noninvasive ventilation, and the vaccines for COVID-19 in children and adolescents are encouraged. WHAT IS KNOWN: • Several clinical practice guidelines for children with COVID-19 have been developed, but only few of them have been recently updated. • We developed an evidence-based guideline at the beginning of the COVID-19 outbreak and have now updated it based on the results of a comprehensive search of the latest evidence. WHAT IS NEW: • The updated guideline provides key recommendations pertinent to the following issues: identification of prognostic factors for death or pediatric intensive care unit admission; the use of remdesivir, systemic glucocorticoids and antipyretics, intravenous immunoglobulin for multisystem inflammatory syndrome in children, and high-flow oxygen by nasal cannula or non-invasive ventilation for acute hypoxemic respiratory failure; breastfeeding; vaccination; and the management of pediatric mental health.

Use of non-steroidal anti-inflammatory drugs and adverse outcomes during the COVID-19 pandemic: A systematic review and meta-analysis.

Background: There are concerns that the use of non-steroidal anti-inflammatory drugs (NSAIDs) may increase the risk of adverse outcomes among patients with coronavirus COVID-19. This study aimed to synthesize the evidence on associations between the use of NSAIDs and adverse outcomes. Methods: A systematic search of WHO COVID-19 Database, Medline, the Cochrane Library, Web of Science, Embase, China Biology Medicine disc, China National Knowledge Infrastructure, and Wanfang Database for all articles published from January 1, 2020, to November 7, 2021, as well as a supplementary search of Google Scholar. We included all comparative studies that enrolled patients who took NSAIDs during the COVID-19 pandemic. Data extraction and quality assessment of methodology of included studies were completed by two reviewers independently. We conducted a meta-analysis on the main adverse outcomes, as well as selected subgroup analyses stratified by the type of NSAID and population (both positive for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) or not). Findings: Forty comparative studies evaluating 4,867,795 adult cases were identified. Twenty-eight (70%) of the included studies enrolled patients positive to SARS-CoV-2 tests. The use of NSAIDs did not reduce mortality outcomes among people with COVID-19 (number of studies [N] = 29, odds ratio [OR] = 0.93, 95% confidence interval [CI]: 0.75 to 1.14, I2  = 89%). Results suggested that the use of NSAIDs was not significantly associated with higher risk of SARS-CoV-2 infection in patients with or without COVID-19 (N = 10, OR = 0.96, 95% CI: 0.86 to 1.07, I2  = 78%; N = 8, aOR = 1.01, 95% CI: 0.94 to 1.09, I2  = 26%), or an increased probability of intensive care unit (ICU) admission (N = 12, OR = 1.28, 95% CI: 0.94 to 1.75, I2  = 82% ; N = 4, aOR = 0.89, 95% CI: 0.65 to 1.22, I2  = 60%), requiring mechanical ventilation (N = 11, OR = 1.11, 95% CI: 0.79 to 1.54, I2  = 63%; N = 5, aOR = 0.80, 95% CI: 0.52 to 1.24, I2  = 66%), or administration of supplemental oxygen (N = 5, OR = 0.80, 95% CI: 0.52 to 1.24, I2  = 63%; N = 2, aOR = 1.00, 95% CI: 0.89 to 1.12, I2  = 0%). The subgroup analysis revealed that, compared with patients not using any NSAIDs, the use of ibuprofen (N = 5, OR = 1.09, 95% CI: 0.50 to 2.39; N = 4, aOR = 0.95, 95% CI: 0.78 to 1.16) and COX-2 inhibitor (N = 4, OR = 0.62, 95% CI: 0.35 to 1.11; N = 2, aOR = 0.73, 95% CI: 0.45 to 1.18) were not associated with an increased risk of death. Interpretation: Data suggests that NSAIDs such as ibuprofen, aspirin and COX-2 inhibitor, can be used safely among patients positive to SARS-CoV-2. However, for some of the analyses the number of studies were limited and the quality of evidence was overall low, therefore more research is needed to corroborate these findings. Funding: There was no funding source for this study.

Potentially effective drugs for the treatment of COVID-19 or MIS-C in children: a systematic review.

The purpose of this systematic review is to evaluate the efficacy and safety of using potential drugs: remdesivir and glucocorticoid in treating children and adolescents with COVID-19 and intravenous immunoglobulin (IVIG) in treating MIS-C. We searched seven databases, three preprint platform, ClinicalTrials.gov, and Google from December 1, 2019, to August 5, 2021, to collect evidence of remdesivir, glucocorticoid, and IVIG which were used in children and adolescents with COVID-19 or MIS-C. A total of nine cohort studies and one case series study were included in this systematic review. In terms of remdesivir, the meta-analysis of single-arm cohort studies have shown that after the treatment, 54.7% (95%CI, 10.3 to 99.1%) experienced adverse events, 5.6% (95%CI, 1.2 to 10.1%) died, and 27.0% (95%CI, 0 to 73.0%) needed extracorporeal membrane oxygenation or invasive mechanical ventilation. As for glucocorticoids, the results of the meta-analysis showed that the fixed-effect summary odds ratio for the association with mortality was 2.79 (95%CI, 0.13 to 60.87), and the mechanical ventilation rate was 3.12 (95%CI, 0.80 to 12.08) for glucocorticoids compared with the control group. In terms of IVIG, most of the included cohort studies showed that for MIS-C patients with more severe clinical symptoms, IVIG combined with methylprednisolone could achieve better clinical efficacy than IVIG alone. CONCLUSIONS: Overall, the current evidence in the included studies is insignificant and of low quality. It is recommended to conduct high-quality randomized controlled trials of remdesivir, glucocorticoids, and IVIG in children and adolescents with COVID-19 or MIS-C to provide substantial evidence for the development of guidelines. WHAT IS KNOWN: • The efficacy and safety of using potential drugs such as remdesivir, glucocorticoid, and intravenous immunoglobulin (IVIG) in treating children and adolescents with COVID-19/MIS-C are unclear. WHAT IS NEW: • Overall, the current evidence cannot adequately demonstrate the effectiveness and safety of using remdesivir, glucocorticoids, and IVIG in treating children and adolescents with COVID-19 or MIS-C. • We are calling for the publication of high-quality clinical trials and provide substantial evidence for the development of guidelines.

Risk factors for poor prognosis in children and adolescents with COVID-19: A systematic review and meta-analysis.

BACKGROUND: This study provides the first systematic review and meta-analysis to identify the predictors of unfavorable prognosis of COVID-19 in children and adolescents. METHODS: We searched literature databases until July 2021 for studies that investigated risk factors for unfavorable prognosis of children and adolescents with COVID-19. We used random-effects models to estimate the effect size with 95% confidence interval (CI). FINDINGS: We identified 56 studies comprising 79,104 individuals. Mortality was higher in patients with multisystem inflammatory syndrome (MIS-C) (odds ratio [OR]=58.00, 95% CI 6.39-526.79) and who were admitted to intensive care (OR=12.64, 95% CI 3.42-46.68). Acute respiratry distress syndrme (ARDS) (OR=29.54, 95% CI 12.69-68.78) and acute kidney injury (AKI) (OR=55.02, 95% CI 6.26-483.35) increased the odds to be admitted to intensive care; shortness of breath (OR=16.96, 95% CI 7.66-37.51) increased the need of respiratory support; and neurological diseases (OR=5.16, 95% CI 2.30-11.60), C-reactive protein (CRP) level ≥80 mg/L (OR=11.70, 95% CI 4.37-31.37) and D-dimer level ≥0.5ug/mL (OR=20.40, 95% CI 1.76-236.44) increased the odds of progression to severe or critical disease. INTERPRETATION: Congenital heart disease, chronic pulmonary disease, neurological diseases, obesity, MIS-C, shortness of breath, ARDS, AKI, gastrointestinal symptoms, elevated CRP and D-dimer are associated with unfavourable prognosis in children and adolescents with COVID-19.

Quality and consistency of clinical practice guidelines for treating children with COVID-19.

BACKGROUND: The Coronavirus Disease 2019 (COVID-19) pandemic negatively affects children's health. Many guidelines have been developed for treating children with COVID-19. The quality of the existing guidelines and the consistency of recommendations remains unknown. Therefore, we aim to review the clinical practice guidelines (CPGs) for children with COVID-19 systematically. METHODS: We systematically searched Medline, Embase, guideline-related websites, and Google. The Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool and Reporting Items for practice Guidelines in HealThcare (RIGHT) checklist were used to evaluate the methodological and reporting quality of the included guidelines, respectively. The consistency of recommendations across the guidelines and their supporting evidence were analyzed. RESULTS: Twenty guidelines were included in this study. The mean AGREE II score and mean RIGHT reporting rate of the included guidelines were 37% (range, 22-62%) and 52% (range, 31-89%), respectively. As for methodological quality, no guideline was classified as high, one guideline (5%) moderate, and 19 (95%) low. In terms of reporting quality, one guideline (5%) was rated as high, 12 guidelines (60%) moderate, and seven (35%) low. Among included guidelines, recommendations varied greatly in the use of remdesivir (recommend: 25%, not recommend: 45%, not report: 30%), interferon (recommend: 15%, not recommend: 50%, not report: 35%), glucocorticoids (recommend: 50%, not recommend: 20%, not report: 30%), and intravenous immune globulin (recommend: 35%, not recommend: 30%, not report: 35%). None of the guidelines cited clinical trials from children with COVID-19. CONCLUSIONS: The methodological and reporting quality of guidelines for treating children with COVID-19 was not high. Recommendations were inconsistent across different guidelines. The supporting evidence from children with COVID-19 was very limited.

Guidelines for the Management of Children and Adolescent with COVID-19: protocol for an update.

BACKGROUND: Coronavirus disease 2019 (COVID-19) has become a constant threat to people's lives, bringing huge challenges to the global public health and medical service system. In order to ensure the timeliness and reliability of the recommendations in guidelines, the working group of the Rapid Advice Guidelines for Management of Children with COVID-19 decided to update the guideline to incorporate the latest evidence to guide the management of COVID-19 in children and adolescent. METHODS: We will update the guidelines, originally developed as a rapid advice guideline, into a standard guideline. We will follow the clinical practice guideline (CPG) update manuals of the National Institute for Health and Clinical Excellence (NICE) and the Spanish National Health System (SNHS). The updated guidelines will also follow the RIGHT (Reporting Items for Practice Guidelines in Healthcare) checklist and Checklist for the Reporting of Updated Guidelines (CheckUp). DISCUSSION: Through systematic search, evaluation and grading of the best available relevant clinical evidence, combined with the experience of frontline clinical experts in the fight against the epidemic and the wishes of patients and their caretakers, we will update our previous rapid advice guidelines into a high-quality, implementable standard guidelines for the management of COVID-19 in children and adolescent. TRIAL REGISTRATION: The standard guideline update has been registered at the International Practice Guidelines Registry Platform (http://guidelines-registry.cn/?lang=en, registration No. IPGRP-2020CN101).

Public health education for parents during the outbreak of COVID-19: a rapid review.

BACKGROUND: It is well-known that public health education plays a crucial role in the prevention and control of emerging infectious diseases, but how health providers should advise families and parents to obtain health education information is a challenging question. With coronavirus disease 2019 (COVID-19) spreading around the world, this rapid review aims to answer that question and thus to promote evidence-based decision making in health education policy and practice. METHODS: We systematically searched the literature on health education during COVID-19, severe acute respiratory syndrome (SARS) and middle east respiratory syndrome (MERS) epidemics in Medline (via PubMed), Cochrane Library, EMBASE, Web of Science, China Biology Medicine disc (CBM), China National Knowledge Infrastructure (CNKI), and Wanfang Data from their inception until March 31, 2020. The potential bias of the studies was assessed by Joanna Briggs Institute Prevalence Critical Appraisal Tool. RESULTS: Of 1,067 papers found, 24 cross-sectional studies with a total of 35,967 participants were included in this review. The general public lacked good knowledge of SARS and MERS at the early stage of epidemics. Some people's knowledge, attitude and practice (KAP) of COVID-19 had been improved, but the health behaviors of some special groups including children and their parents need to be strengthened. Negative emotions including fear and stigmatization occurred during the outbreaks. Reliable health information was needed to improve public awareness and mental health for infectious diseases. Health information from nonprofit, government and academic websites was more accurate than privately owned commercial websites and media websites. CONCLUSIONS: For educating and cultivating children, parents should obtain information from the official websites of authorities such as the World Health Organization (WHO) and national Centers for Disease Control, or from other sources endorsed by these authorities, rather than from a general search of the internet or social media.